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ASYMPTOTIC BEHAVIOR OF EDGE-REINFORCED 
RANDOM WALKS 

By Franz Merkl and Silke W. W. Rolles 

University of Munich and Technische Universitdt Miinchen 

In this article, we study linearly edge-reinforced random walk on 
general multi- level ladders for large initial edge weights. For infinite 
ladders, we show that the process can be represented as a random 
walk in a random environment, given by random weights on the edges. 
The edge weights decay exponentially in space. The process converges 
to a stationary process. We provide asymptotic bounds for the range 
of the random walker up to a given time, showing that it localizes 
much more than an ordinary random walker. The random environ- 
ment is described in terms of an infinite- volume Gibbs measure. 

1. Introduction. Edge-reinforced random walk on a locally finite undi- 
rected graph is the following process: Every edge is assigned a weight which 
changes with time. Initially, all weights equal a constant a. The random 
walker starts at a vertex 0. At every time, the random walker jumps to a 
neighboring vertex with probability proportional to the weight of the tra- 
versed edge at that time. Each time an edge is traversed, its weight is in- 
creased by 1. 

This model was introduced by Diaconis in [1] and [2]. The process is par- 
tially exchangeable. Already in 1980, Diaconis and Freedman [3] proved for 
the more general class of partially exchangeable processes a representation 
as a mixture of Markov chains, provided the process is recurrent. 

In the late 1980s, Diaconis asked whether edge-reinforced random walk 
on Z'^ is recurrent. Except for d = 1, this problem is still unsolved. On an 
infinite binary tree, Pemantle [8] showed a phase transition in the recurrence 
and transience behavior of edge-reinforced random walk. For general finite 
graphs, Coppersmith and Diaconis [1] found an explicit description for the 
limiting fraction of time spent at the edges. Their result was extended by 
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Keane and RoUes [6]. In [9], Rolles showed that a class of models can be 
represented as a mixture of reversible Markov chains. This result applies 
in particular to edge-reinforced random walk on any finite graph. Edge- 
reinforced random walks were used in [4] to provide natural Bayesian priors 
for reversible Markov chains. 

In [7], we proved that the edge-reinforced random walk on the ladder 
Z X {1,2} is recurrent for all initial edge weights a > 3/4. This result was 
generalized by one of the authors in [10] to graphs of the type Z x G and No x 
G, where G is a finite tree, provided that the initial weights are sufficiently 
large. 

In this article, we examine the asymptotic behavior of these edge-reinforced 
random walks on the infinite ladder Nq x G in much more detail beyond re- 
currence. 



Formal description of the model and notation. We consider edge-reinforced 
random walk on a graph G = {V,E). The vertex set V is of the type 
y = No X y with a finite set V, \V\ > 2. The set V is assumed to be the 
vertex set of a finite tree G = {V, E). Two vertices (i, f ), {i' ,v') £ V are con- 
nected by an edge in E iS i = i' and v, v' are connected by an edge in E, or 
|i — i'l = 1 and v = v' . The edges of G are undirected. The edge-reinforced 
random walker starts at level of G, that is, in a vertex = (0, v). 

Furthermore, we assume the initial weights a to be sufficiently large. More 
quantitatively, we assume a > amin, where amin = 3/4 if V = {1,2} , and 
otherwise Omin = o,ram{G) denotes the lower bound specified in formula (1.7) 
of [10]. Optimizing the lower bound for a is not treated in this paper. 

The edge-reinforced random walk on G is formally defined as follows: Let 
Xt : — > V denote the canonical projection on the tth coordinate; Xt is 
interpreted as the location of the random walker at time t. For t G Nq, we 

define wt{e) : v'^° M+, the weight of edge e at time t, recursively as follows: 

(1.1) Wo{e) := a for all e G i?, 

n 9^ ,„ .- i wt{e) + 'i^, ioi e = {Xt,Xt+i}£E, 

(1.2) ^.,+l(e).-|^^^^^^ eeE\{{X„Xt+,}}. 

The distribution Pq of the edge-reinforced random walk is a probability 
measure on , defined by 

(1.3) Xo = 0, Po-a.s., 

r Wti{Xt,v}) .rry 

(1.4) PoiXt+1 = v\X,,i = 0,l,...,t] = l Ei.eE: x.e.y Me) ' 'n^t,viei,, 

{ 0, otherwise. 

For a vertex {i,v) S V, we set 1(^,^)1 := |^|, and we abbreviate Vi := {i,v). 
If e = {u,v} is an edge in the finite graph G, we set := {ui,Vi}. For an 
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edge e = {u,v} G E, we denote by |e| its distance from level 0: we set |e| := 
min{|ii|, Constants are denoted by Cj, i > 1. They keep their meaning 
throughout the whole article. 

2. Results. 

2.1. Position of the random walker at large times. Typically, at time t, 
simple random walk is located at a distance of the order \/t from its starting 
point. In contrast to this fact, the typical location of edge-reinforced random 
walk at time t does not go to infinity as t grows. In fact, the location of the 
reinforced random walk at time t is stochastically bounded by a random 
variable with exponential tails, uniformly for all times t. This is the claim 
of the following theorem: 

Theorem 2.1 (Uniform exponential tails for the location of the random 
walk). There exist constants ci,C2 > 0, depending only on G and a, such 
that for all t,n gNq, the following bound holds: 



As a consequence, up to time t, the edge-reinforced random walk can travel 
at most a distance of the order Int: 

Corollary 2.2 (Range of the random walk path up to a given time). 
There exists a constant C3 = 03(0, a) > such that Po-a.s., 



Simple random walk does not converge to an equilibrium distribution. 
Reinforcement makes this behavior change drastically. As is shown in the 
following theorem, the law of the location of the reinforced random walk 
tends to an equilibrium distribution as time grows. 

However, the graph G has a chessboard structure. Half of the vertices can 
only be reached in an even number of steps, and the other half only in an 
odd number of steps. Therefore, we can only expect limit theorems for the 
reinforced random walk restricted to all even or all odd times. For these two 
restricted processes, we have indeed the following limit theorem: 

Theorem 2.3 (Convergence to equilibrium). As t ^ 00, the distribu- 
tions of X2t and X2t+i converge in the following sense: There exist proba- 
bility functions //even and Hodd on the vertex set V , such that for all vertices 
V gV , the following hold: 





(2.2) 



max \XJ < cs Int 



for all t large enough. 



(2.3) 




(2.4) 
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With the constants ci,C2 > from Theorem 2.1, one has for all vertices 
v£V: 

(2.5) /ieven(t^)<cie-'^2'"' and /iodd(^^)<cie-^2H. 

Let Vcvcn and Vo^d denote the set of vertices v £V which can be reached 
in an even and odd number of steps, respectively, by the random walker 
starting from 0. The measures //even and /todd are supported on Vcvcn and 
Vodd, respectively. 

2.2. Random walk in random environment representation. Edge-reinforced 
random walk on any finite graph can be represented as a unique mixture of 
reversible Markov chains. This is shown in Theorem 3.1 of [9]. 

Recall that the transition probabilities of any irreducible reversible Markov 
chain on any graph {V,£) can be described by weights x = {xe)eee, Xe > 0, 
on the edges of the graph; the probability to traverse an edge is proportional 
to its weight. More precisely, denoting the distribution of the Markov chain 
induced by the edge wGiglits X witli starting vertex v by Qv^x^ 

one has 

(2.6) QvA^t+i = u'\Xt = u) = 

Xu 

where here and in the following we set 

(2.7) Xu ■■= ^e- 

Edge-reinforced random walk on the infinite graph G can also be rep- 
resented as a unique mixture of reversible Markov chains. Moreover, the 
corresponding random weights (Xf,)^^-^ are summable. This is shown by the 
following theorem. 

We introduce the infinite simplex A := {(xe)^^-^ G (0, 1)'^ : X^ee'E ~ 

Theorem 2.4 (Mixture of positive recurrent Markov chains). The edge- 
reinforced random walk on the infinite ladder G can he represented as a 
unique mixture of the reversible Markov chains Qv,x ■ Even more, the mixing 
measure is supported on positive recurrent Markov chains. Hence, there is a 
unique probability measure Q on A such that 

(2.8) Po{A)= I Qo,M)'^i.dx) 

J A 

is valid for all events A C . 

Let g''"'* = (y^^\E^^^) be the restriction of G to the finite vertex set 
{0,1,..., n} X V. On G , we can also describe the mixing measure as a 
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measure on the space of weights. Let x^"'^ = (xe ) — („) denote the edge 

weights, normahzed such that J2 — («) ^e^'^ = 1- We denote the mixing mea- 

sure for the weights x*^"^ by Q^"). 

Let eQ be a fixed edge in the rung at level 0, incident to the starting vertex 
0, that is, eg = {{0,u), {0,v)} for some {u,v} E E and S eg- The following 
theorem shows that the edge weights decay exponentially in space with 
probabilities exponentially close to 1, even when we normalize the weights 

(n) 

by dividing by x\, . This is true on the infinite ladder, but also on any finite 
ladder, uniformly in the size of the ladder. 

Theorem 2.5 (Exponential decay of the edge weights). There exist pos- 
itive constants C4,C5,cq depending only on G and a such that for all ??, G N 

— (n) 

and all edges e of G , we have 

(2.9) Q(")(4") > 2:i2^e-^*l"l) < cse-'^^l"', 

uniformly in n. On the infinite ladder G, we have the similar hound 

(2.10) Q(xe>Xe5e"^^l^l)<C5e-^6l'=l 
for all e£ E. 

As a corollary, we obtain that the weights decay exponentially in space 
almost surely, even uniformly from a certain (random) point on. We can use 
any fixed edge / to normalize the weights. 

Corollary 2.6 (Exponential decay of the edge weights). Let f € E be 
a fixed edge. There exists a positive constant Ci{G,a) > with the following 
property: For Q- almost all x £ A, there exists a (random) n G Ng, such that 
for all edges e with \e\ >n, one has 

(2.11) Xe<e-"^l"l/2xj. 

Let vr = (fg = 0, ui, . . . , Vk) be a finite path in G. Conditioned on {Xq, . . . , 
Xk) = vr, the shifted process {Xk+t)t<=No is again an edge-reinforced random 
walk starting at Vk with initial edge weights given by 

k 

(2.12) a + Y,'^{{v,^iM=e}^ eeE. 

1=1 

The shifted process can also be represented as a unique mixture of reversible 
Markov chains: 
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Theorem 2.7 (ERRW conditioned on a finite path). For any finite path 
TT = (vq = 0,fi, . . . ,Vk), there exists a unique probability measure on A, 

such that for all measurable A C V^" , we have 

(2.13) Po{{Xk+t)teNo^MXs)s=o,...,k = T^)=f Qv,AA)QAdx). 

J A 

The measure is absolutely continuous with respect to Q; the Radon- 
Nikodym derivative is given by 

^ ^ dQ^^^- Po((X.).=o,...,fc = vr) ' 

The next theorem is concerned with the infinite-volume hmit of the ran- 
dom environment. It shows that the random environment for finite ladders 
converges to the random environment for the infinite ladder as the size of 
the ladder grows. 

Theorem 2.8 (Infinite-volume limit). Asn^ oo, the finite- dimensional 
marginals o/Q^") converge weakly to the corresponding marginals of Q. 

The next theorem tells us that ratios of the random weights of edges do 
not fluctuate too much: For neighboring edges e, e', the random variables 
X(,/xei are tight. The theorem makes even a more quantitative statement: 

Theorem 2.9 (Tail behavior of edge weights). Let e,e' be edges on level 
i,j, respectively. With respect to Q, the random variable 

(2.15) In^ 

Xe' 

has exponential tails. More precisely, there exist positive constants 07(0), 03(0) 
such that for all i,j G N, edges e,e' as above, and M > 0, one has 



(2.16) 



1 Xe 
Xp' 



> M 



< crmaxj z -J ,l|exp<^ — — -- \. 

L max{|^ - j|,l} J 



2.3. Convergence to equilibrium. In this subsection, we extend and refine 
the convergence result of Theorem 2.3. First, we describe the equilibrium 
measures //even and /Xodd from that theorem in terms of the random envi- 
ronment. 

We define Xeven, a^odd : F ^ [0, 1] , by 

(2.17) Xeven(w) := ly^^^^^(u)x„ and Xodd{v) ■.= ly^^^{v)xy. 

Since every e£ E contains one vertex in l^even and one vertex in T^odd; we 
have 

(2.18) '^Xe^feniv) = ^XoAd{v) = ^Xe = l. 
■uGV v&V eGE 
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Hence Xeven and Xodd are probability functions. By averaging these proba- 
bility functions over the environment, we get the equilibrium distributions 
/ieven and /Xodd- This is the claim of the following theorem: 

Theorem 2.10 (Annealed equilibrium measures are mixtures). The mea- 
sures /ieven CLiT-d /Uodd from Theorem 2.3 have the following representation: 



(2.19) 




{v £ V). 



For any probability function fi:V ^ [0,1] and x £ A, we define the law of 
the random walk in the environment x with starting distribution 

(2.20) Q^,^ := fi{v)Q^,^. 

In analogy to the convergence in distribution of X2t and X2t+i as stated 
in Theorem 2.3, there is a convergence result for the whole process: 

Theorem 2.11 (Convergence to equilibrium of the process). As s ^ oo, 
the distributions of {X2s+t)teNo Q^^*^ (-'^2s+i+t)tgNo converge in the following 
sense: For all measurable sets A C v'^'^ , one has 

(2.21) p^^^X2s+t)teNo^A)'^ f Q._,:.(^)Q(dx), 

J A 

(2.22) Po((X2.+i+0ieNo G ^) ™ / Q,„,„,(A) Q(dx). 

J A 

We can interpret ^^^^^(f) and a^Qdd (f) as the asymptotic probabilities 
to visit a vertex v at even and at odd times, respectively, as time goes 
to infinity, conditioned on the environment. Even more, conditioned on the 
environment, the whole shifted process converges to a Markov chain, started 
in equilibrium: 

Theorem 2.12 (Convergence to equilibrium, conditioned on the environ- 
ment). For all X G A, the laws of X2t and of X2t+i with respect to Qo,x 
converge: 

(2.23) lim Qo^x{X2t =v)= Xeven(f ), 

(2.24) lim Qo^x{X2t+i =v)= Xoddiv) for all v gV. 
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More generally, for all AC V measurable, 

(2.25) Qo,x((^2s+t)tGNo G A) Qx._,x(^) 

and 

(2.26) QoAiX2s+i+t)tmo e A) Q.„,„x(A). 

2.4. A representation of the random environment by an infinite-volume 
Gibbs measure. In this subsection, we show that the random environment 
for the reinforced random walk on the infinite graph G can be written in 
terms of an infinite-volume Gibbs measure. For finite pieces of G, the de- 
scription in terms of finite-volume Gibbs measures is one of the central ideas 
in [7] and [10]. Here, we deal with the thermodynamic limit of these Gibbs 
measures. But first, we review the state spaces for the local spin variables; for 
more details in the finite-dimensional setup see [7] and [10]. Roughly speak- 
ing, every level of the ladder corresponds to a "compound spin variable." 
Although the precise form of the state spaces is irrelevant for almost all 
arguments that will follow, we explain very briefly their intuitive meaning: 
The rungs of the ladder are the subgraphs {i} x G, that is, the vertical edges 
if we view the ladder as going from the left to the right. On the other hand, 
the (horizontal) edges connecting these subgraphs constitute the "slices" of 
the ladder. 

Very roughly speaking, the spin variables consist of logarithms of ratios 
of neighboring edge weights. Besides, the spin variables have also discrete 
components. These discrete components provide local descriptions of span- 
ning trees on the one hand and on the other hand some signs which are not 
encoded in the logarithms above. The precise connection between the spin 
variables and the edge weights is given in Definitions 2.19 and 3.2, below. 

In the whole article, we use the more general notation, the state spaces, 
and the variable transforms from [10] rather than [7]. However, in the special 
case G = No X {1,2}, the variant described in [7] could also be used. This 
variant uses a slightly different variable transform, and it applies to all initial 
weights a > 3/4 rather than only large a. Therefore, we include below also 
citations of [7]. Readers interested only in large a may ignore them. 

Definition 2.13 (State spaces). As in Definition 2.15 of [10] (see also 
Definition 2.8 of [7]), we fix two different vertices G V, and we set 

^icft := 

(2.27) 

Osiice :=M^ X {±l}^\{-"'=^-*} X Ry\i-'-^-'} X TVeevar, 
(2.28) l^rung :=]R^ X M; 
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here Treevar is a finite set (see Definition 2.7 of [10]). Furthermore, we define 
the index set 

(2.29) T:= {left} U {(rung, f),(sHce,i): i£N}. 
For any ACT, we define 

(2.30) OA:=nf^M 

where ilrung.i = ^rung and r^siico.i = f^siicc for i G N. We abbreviate O = J^x- 
The c7-algebra on induced by the canonical projections, is denoted by 
^(^^a). 

For most parts of our arguments, even the precise form of the components 
of the compound spin variables is irrelevant. Thus, we introduce abbrevia- 
tions for the compound spins: 

Definition 2.14 (Local state variables) . For A C T, we denote the canon- 
ical element of CIa by := (wJ^gA- We use the following notation from Def- 
inition 2.15 of [10] for the components of (see also Definition 2.8 of [7]): 

(2.31) Wslicc.i := {{Xi{v))y(zV,{(7i{v),Wi{v))^^y\^^trcc^i,,},Ti), 

(2.32) Wrung.i := ((^i(e))eg£;,ri), 
where i G N. In addition, 

(2.33) c^ieft := iiZo{e)UE). 

The components Xi{v), Wi{v), Zi{e), and Fj take values in M, whereas 
ai{v) and Tj take only finitely many values. We denote by duj\ the Lebesgue 
measure on the continuous components times the counting measure on the 
discrete components. 

For n G N, we consider the index set 

(2.34) [0, n] := {left} U {(rung, i), (slice, i) -.i = 1, . . . ,n} Cl 

with boundary 9[0, ??,] := {(slice, n+ 1)}. 

Let i/middlc := -ffmiddle,a,i/4 and Hicit := i?ieft,a be the local Hamiltonians 
as defined in Definitions 2.18 and 2.20, respectively, of [10] (see also Defini- 
tions 2.10 and 2.11 of [7]). Their explicit form is irrelevant for this paper. 
Since the initial weight a is kept constant, we suppress it in the notation. Us- 
ing these local Hamiltonians, the finite- volume Gibbs measures are defined 
in the standard way as follows. 
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^ningfl ^rMn>2;..'i ^isiMfi.l 



\ ''irii.l.JI.- \ ^mtJiEl.. 



U O- O- O- Q- 

ffsliie,! W slice, 2 C0slieB,3 slice, 4 fJslice.S 

Fig. 1. Interactions in the Gibbs measure. 

Definition 2.15 {Finite-volume Gibbs measures with boundary condi- 
tions). Let n G N and A = [0,n]. We define the finite- volume Hamiltonian 
with boundary conditions ujq\ by 

H[0,n]i^lO,n]\^d[0,n]) '■= -^leftl'^left, t^slicc,l) 

(2.35) 

n 

~l~ ^ ^ -f^middlc (''-'slice, i) ''-'rung,i ) '-'-'slicc,i+l) ■ 
1=1 

Furthermore, for any bounded and measurable function F : 0,\ M, we in- 
troduce : — > M by 

(2.36) 9iM-=l FMe-''^^^^^^^^^ diVA. 

The finite- volume Gibbs measure ¥A{-\uJdA) is given by the Markov kernel 
Ka : B{Qa) X Qqa [0, 1] , where 

(2.37) KA{A,ujaA):='4rH- 

Figure 1 illustrates the interactions in the Gibbs measures as described by 
the local Hamiltonians. The local interactions -^middle are drawn nonsym- 
metrically; this represents symbolically the absence of reflection symme- 
try caused by the symmetry-breaking terms rj/4 arising in the summand 
^^middic('^siice,i,t^rung,i,Wsiicc,i+i) (scc (2.41) of [10] and (2.42) of [7]; recall 
that in the notation of these articles, i/middic = -f^middie,a,i/4)- 

A central role in our analysis is played by the transfer operator and its 
leading eigenfunctions from the left and from the right. The transfer operator 
is an integral operator with an integral kernel k defined as follows: As in 
Definition 4.1 and in particular (4.4) of [10] (see also Definition 4.2 and 
(4.5) of [7]), we define 



(2.38) k{uJslicc,i^'s\ice)-= e~-^-'ddlc(a;.iice,a^ru„g,<i,J^^ 



rung) 
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in the notation of [7] and [10], k = for t] = 1/4 and T = 1. The transfer 
operators, that is, the (left and right) integral operators with integral kernel 
k, have a positive leading eigenvalue A, as was shown in Lemma 4.2 of [10] 
(see also Lemma 4.4 of [7]). Let v, v* denote their leading eigenfunctions; 
they are positive and unique up to normalization: 

(2.39) / A;(u;slice,Wslice)^*('^slicc)'^^slice = ^^*('^slice), 

(2.40) / f (a;siico)A;(u;siico,u;giicc)dwsiicc = Ai;(u;siice)- 

The infinite- volume Gibbs measures are defined by averaging finite volume 
Gibbs measures with boundary conditions weighted according to the right 
eigenfunction of the transfer operator, just as always in one-dimensional 
Gibbs systems with short-range interactions. 

Definition 2.16 {Infinite- volume Gibbs measure). We define the infinite- 
volume Gibbs measure P as the unique probability measure on B{^}) satis- 
fying 

(2.41) P(u;a gA) = In,,9]:'Mv*Mdua^ 

for all A = [0, n] and A £ S(Oa)- 

Lemma 2.17 (Infinite- volume Gibbs measure). The infinite-volume Gibbs 
measure ¥ is well defined. 

Indeed, the infinite-volume Gibbs measure satisfies the DLR-conditions: 

Theorem 2.18 (Dobrushin-Landford-Ruelle conditions). The kernel 
Ka is a regular conditional distribution of u}\ with respect to P conditioned 
on loq\. In particular, for any set A S I3{^Ia), we have 

(2.42) F{ujAeA\uj9A) = KA{A,uj9A). 

Slightly more generally, for any bounded measurable function F -.Q^M. 



(2.43) Fd¥= / F{xA,oJAc)KA{dxA,uJdA)^{duj). 

Jn JnJnA 

Next, we define a transformation from uj Gil. to the edge weights [xe)^^ £ 

M^. Up to a normalization, the Xe turn out to be the random environment for 
the reinforced random walk; see Theorem 2.21, below. The transformation is 
the same as in Definition 2.17 of [10] with the abbreviations from Definition 
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2.16 of [10] plugged in (see also Definition 2.9 of [7]). The form of this 
transformation is motivated in [7] and [10]. Its precise form is used in [7] and 
[10] to derive bounds which are also relevant in the present paper. However, 
the precise form of the transformation is not used below. 

For the following definition, recall the notation Cj for edges, introduced 
after formula (1.4). 

Definition 2.19 {Transformation from state variables to random envi- 
ronment). For € ri, we define 

(2.44) x{io) = ixeiuj))^^-^£Rj=iO,^f 
as follows: We set for v £V and i G N 

(2.45) ^{„,„l,^,,} 



gX,(.*)-Zo(e*)^^p 



i-1 



X,{v)-X,{v*)-Y,^j 
i=i ■ 



and for eG E 

(2.46) :=exp[Zo(e)-Zo(e*)], 



„Xi(t;*)-Zo(e*) 



(2.47) 



i-1 



Zi{e) - ^{Xi{v*) + Xi+i{v*) + rj - ^ r,- 



X exp 

We define Q to be the law of x with respect to P. 



Clearly, x^* = 1 • We want to change the normalization of the edge weights 
(xe)e in such a way that they sum up to one. This is done in the follow- 
ing definition. Note that multiplying all edge weights (xe)gg-g by the same 
positive constant does not change the measure Qv,x- 

Definition 2.20 {Changing the normalization). We define x{uj) = 
{xe{uj))^^-^eA by 

(2.48) xe := ^ , 

whenever these random variables are well defined. 



By a slight abuse of notation, we use the same symbol Xe in two slightly 
different ways: On the one hand, x = {xe)e S E denotes weights of the ran- 
dom environment, for example, in Theorem 2.4. On the other hand, for 
example, in (2.48), Xe{io) denotes the value of a random variable on Q. The 
following theorem justifies this little abuse of notation: 
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Cor. 2.2 




Thm. 2.1 










Tlmi. 2.12 




Tlim. 2.11 




Thm. 2.7 




Cor. 2.(i 



Fig. 2. 



Theorem 2.21 (Representation by an infinite- volume Gibbs measure). 
Let uj be a random variable with distribution ¥. Then, the distribution Q 
of x{lo) equals the distribution of the random environment, normalized such 
that the reference edge gets weight Xg* = 1- 

In addition, x{uj) is almost surely well defined. Its distribution equals Q, 
the distribution of the random environment, normalized such that J2eeE^^ ~ 
1. 

3. Proofs. 

Organization of this paper. The order in which the results are proven dif- 
fers from the order in which we presented them. The compUcated dependence 
structure between the theorems is best represented graphically: Figure 2 
displays the mutual dependence of the lemmas, theorems and corollaries in 
this paper. Lemma 2.17 (P is well defined) and Theorem 2.18 (Dobrushin- 
Landford-Ruelle conditions) are not represented in Figure 2. 

3.1. Analysis of the infinite-volume Gibbs measure. 

Proof of Lemma 2.17. First, observe that the integrands arising in 
(2.41) decay exponentially at infinity. For i^middic and i/icft, this is shown in 
Propositions 3.1 and 3.9 of [10] (see also Propositions 3.2 and 3.5 of [7]). Be- 
cause of the eigenvalue equation (2.39), the decay of the local Hamiltonians 
implies the exponential decay of v* . Thus, the numerator and the denom- 
inator of the fraction in (2.41) are both finite. The denominator is strictly 
positive. 

The set of events of the form "wa G A" is closed under intersections and 
generates i3(0). Hence, it remains to show that the definition (2.41) does 
not depend on the choice of A, that is. 



(3.1) 



P((JA/ G A') = P(WA G A) 
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holds whenever A C A', A G B{^}a), and A' is the inverse image of A with 
respect to the projection J^a' — ^ ^^A- It suffices to take A' one step bigger 
than A. 

Let A = [0,n- 1], A' = [0,n]. By the definition (2.41) of P, 
(3.2) 

Observe that A' = A U dA U {(rung, n)} and 

(3.3) HAi{uJA'\l^dA') = H\{uj\\uQ\) + i^middlc(i^aA,'^rung,n,'^OA')- 

Hence, by Fubini's theorem, 

9\^'{^aA') = I d^A'lA'(^A')e-^^'("^'l"s^') 



A' 

(3.4) 

X / (iwAU(wA)e--f^^('^^l'^s^) 
= / duQt^k{ujQiy,UdA')g^^{'^dA)- 

Rewriting (2.39) as 

(3.5) / k{uJaA,oJdA')v*{i^dA')duJdA' = >^v*{uJdA) 

and applying Fubini's theorem, we conclude that 

g]^' ii^dA')v* i^^dA' ) duJdA' 
(3.6) 

= ^ gY{'^dA)v*{LVdK)duaA. 

The last identity with A replaced by Oa and A' replaced by J7a' gives an 
identity for the denominator in (3.2). Combining these two identities yields 
the claim (3.1). □ 



Proof of Theorem 2.18. It suffices to prove (2.43) for nonnegative 
functions F that depend on only finitely many components, say F : Oa' ~^ 
where A' 5 A U dA. We decompose H^' as 

(3.7) Ha'{uj\'\ujqa') = H\{ijJ\\u;q/^) + -f/'A',A(i^A'\Al'^9A') 



ASYMPTOTIC BEHAVIOR OF ERRW 15 

with a sum of local Hamiltonians i^A',A('^A'\Al'^9A') ■= -f^A'('-^A'|'-^9A') ~ 
Ha{uj\\ujq\) that depends only on wa'\a and ujoa'- We calculate for uq/^i G 



(iwA'e"-^A'K'l'^sA')i?(^^,) 



A' 



(3.8) 



dxA / dwA'\Ae~-^''^^^''^^^^e~^A',A('^A'\Al'^sA') 
Qa JQa'\a 

gAi^dA) JQa 

duJA f dc^A,^Ae-^^('^^l'^9A)g-^^A',AK'\Al'^eA') 
Qa •'^a'\a 



X / dxAe 



-h,{^,\u^^,) PUa,uja'\a) 

gii^dA) 



da;A'e-^A'{-A'l-eA') / KA{dxA,iOdA)F{xA,ujA'\Ay, 

^A' ^A 

recall definition (2.37) of the Markov kernel Ka. Claim (2.43) follows using 
the definition (2.41) of P: one multiplies the finite-volume DLR-equation 

(3.8) by the eigenfunction v*{ujdA')^ integrates with respect to dujQA', and 
divides by the normalizing constant Jq^^, g\i{l-^dA')''J*{'^dA')d^dA' ■ D 

Recall that G*'"'* = (y^"\£'^"^) denotes the restriction of the graph G to 
the finite piece V^^"^ = {0, . . . , n} x F . 

Definition 3.1 {Finite-volume Gibbs measures). For n G N, we define 
in analogy to Definition 2.13: 

(3.9) bright :=M^, 

:= {left} U {(rung,i), (slice, i) : 1 < i < n - 1} U {(slice, n), right} 

(3.10) = [0,n- 1] U {(slice, n), right}, 

(3.11) 0("):= n 

The canonical element of 0^'"^ is denoted by u;*-"^. 

Let -ffright '■= -f^right.a be as in Definition 2.21 of [10] (see also Defini- 
tion 2.11 of [7]). We define the finite- volume Hamiltonian over X*-"-* as follows: 

F(")(a;(")):=/7ieft(cc.lcft,cusiicc,i) 
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n-1 



~l~ ^ ^ -f^middlc (''-'slice, 15 ''-'rung, i) '^sliceji+l) 



«=1 

(3.12) 

-|- -f^right (''-'slice, ni ''-'right) 
= -f^[0,n-l](''^[0,n-l]l''^9[0,n-l]) + -f^right (''^a[0,n-l] > ''^right) • 

Finally, the finite-volume Gibbs measure P^") is defined to be the probability 
measure given by 

For A G i3(r2[o,n-i])) this comes down to 

. s /f^^j.^^5'[^Q^^_-^j(u;slico)5right('i^slico)d'^sIice 

^ ('^[0,n-i] G ^) = 7 1 7 ^ 7 r-^ 

Jn Y 9\Q l,''-'sliccj9rightV''-'slicoj "''-'slice 

(3.14) ;j 

_ (5[o'^„_.i] bright) 
{9[o.ri-l]9right) 

where 

(3.15) bright ('^slice) = / e-^^'shtK,ico,-HgM)^^^.gj^^ 

bright 

and (/(/) is a short notation for /q^j.^^ /('^slicc)5'(''^slicc) ^''^slice- 

Definition 3.2 (Transformation of variables — finite volume version). 
For G we define 

(3.16) xW(a;W) = (5;W(a;W))^^-(„) eMf 

as follows: Whenever e is not an edge in the right border of the finite ladder 

that is, whenever e ^ {un,Vn} for all {u,v} £ E, we define Xe"^ just as 
in (2.45), (2.46) and (2.47) in Definition 2.19. However, if e is an edge in the 

right border of the finite ladder G , that is, if e = e„ = we set 

r n-l 

(3.17) := e^iK)-^o(e*) ^^^p z^{e) - X^iv*) - T, 

I j=i 

Let Q(") denote the law of ^("^(w^")) = (xi"Vu;("))) -{„) , provided that 
has the distribution p("). Finally, we set 
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Random variable Normalization Law 

Infinite- volume 

State variable uj P 

Random environment x = 1 Q 

Random environment x X/egE'^'^ ~^ ^ 

Finite-volume 

State variable tj*") P*"' 

Random environment i^"' i'"' = 1 Q'"' 

Random environment a;'^"' ^ a;e = 1 Q'"' 



Thus, we use two different normalizations: The "tilde" version, where 
the reference edge Cq gets weight 1, and the "no-tilde" version, where all 
weights sum up to 1. Note that, in addition to (3.18), we have the following 
conversion between the "tilde" and "no-tilde" normalization: 

(") 

(3.19) 4"^ = ^, xe = — and 



It turns out that the xf'\uj^'^^) have the distribution Q'-^^ provided that 
a;^"^ has the law p("\ This is a consequence of Lemma 3.3 below. 

As a mnemonic aid. Table 1 summarizes the finite-volume and infinite- 
volume measures and the corresponding random variables. 

Note that P, Q, p("), and Q(") are by definition the laws of the random 
variables w, x(w), w^"^ and x(")(a;*'"-*), respectively. However, the fact that 
Q is the law of x{uj) is stated in Theorem 2.21, and the fact that the Q^"^ 
is the law of x^"'^(cl'^"^) is a consequence of the results in [7] and [10]. This 
is made precise in the following lemma: 

Lemma 3.3 (Connection between Gibbs measure and random environ- 
ment — finite- volume version). The measure Q^"\ that is, the mixing mea- 
sure describing the random environment for reinforced random walk on thefi- 

— (n) 

nite ladder G , equals the joint distribution of the random variables 
(xi"^(a;("))) -(„), provided that has the law P("). 

Moreover, let F d E be finite. Take n large enough so that F C E^"^ . 
Then {xe{io))eGF equals (xi"'^(a;^"^))egi?, provided that C(j[o,n-i] ~^io^n~i]' 



Proof. Combining Lemma 2.24 of [10] and Definition 2.17 of [10] (see 
also Lemma 2.13 of [7] and Definition 2.9 of [7]), the first claim follows. 
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To prove the second claim, note that each Xe{uj) depends only on finitely 
many components of lo. More precisely, it depends only on i^[o,n-i]) if 

— (n) 

edge e is on a level strictly less than n — 1 . Consider a finite ladder G and 

any edge e G -E*''^ Then, the transformation uj i— > X(.{oj) described for the 

infinite ladder in Definition 2.19 coincides with the map a;^"-* i— > xi"^(a;^"^) 

for the finite ladder G , given in Definition 3.2; see also Definition 2.17 
of [10] and Definition 2.9 of [7]. This proves the second claim. □ 

Lemma 3.4 (Thermodynamic limit). As n ^ oo, the finite- dimensional 
marginals ofF^'^^ converge weakly to the corresponding marginals o/P. Even 
more, for any measurable bounded function f depending only on finitely 
many coordinates ooi, i £ I , we have 

(3.20) Jim^ j f{uJi,ie /)p(")((ia;) = J f{uJi,ie I)F{diu). 
A similar statement holds for Q(") Q. 

Proof. Let K : L'^{n^ncc) ^ ^^(^^sUcc), 

(3.21) Kf{uJslicc)-= fc(u;slice,Wslicc)/(^slico)^^^^slicc 

denote the integral operator with integral kernel k, defined in (2.38). Fur- 
thermore, normalizing the integral operator by its leading eigenvalue A, we 
set K := \-^K. 

Let I G N, and take a bounded measurable function / depending only on 
wjo^/]. Take n> I. Then, using the boundary function bright from (3.15), we 
write 

(3.22) / /(..)fH(..) - ^^[o^'l^""^--^ - ^4^^]^""^--) . 



(9[0,/]^""'5right) (5fo,,]^"~'5right) ' 

recall the definition (2.36) of g^^^p^ G {Q.s\ice) ■ Now, for fixed / G N, Corol- 
lary 4.3 in [10] (see also Corollary 4.5 in [7]) states that 

(3.23) i^"-'9right™r^*(t^5right) in ^^(au,,), 

where we assume that the eigenfunctions v and v* are normalized such that 
{vv*) = 1. Note that the scalar product (t'fi'right) of positive functions does 
not vanish. We get 

(3.24) 

'V[0,i]' 



lim 



/(L^A)P(dc^), 
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using the definition (2.41) of P in the last step. This proves the claim (3.20). 
To prove the statement for Q(") — > Q, consider a bounded measurable func- 
tion g{{xe)e£F), depending on finitely many components {xe)e<=F, F C E 
being finite. Consequently, using the second part of Lemma 3.3, one has for 
all large n: 

5(xi"^;eGF)Q(")((ix) = J 5(xi"^(a;(")); e G F) p(")(da;) 

(3.25) J 5(ie(a;);eeF)P(dw) 

g{xe;eeF)Q{dx), 
which completes the proof of the lemma. □ 

Lemma 3.5 (Exponential decay of the edge weights). There exist posi- 
tive constants 04,05, cg depending only on G and a such that for all n£N 

— (n) 

and all edges e of G , we have 

(3.26) P(")(x("^ > e-^^l^^l) < cse-'^'^l'^l, 

uniformly in n. On the infinite ladder G, we have the similar hound 

(3.27) P(Xe> 6-^*1*^1) <C5e-^''|e|_ 

Proof. We denote by Pq"^ the distribution of the edge-reinforced ran- 

dom walk on the finite graph G . For e G F and t G N, let fct(e) denote the 
number of times the reinforced random walker traverses the edge e up to 
time t. By Theorem 1.2 of [10] (see also Theorem 1.2 of [7]), there exist pos- 
itive constants 04,05, ce depending only on G and a such that for all n G N 
and all edges e G F , we have 



g C6|e| 



(3.28) ^i"^(lim|^>e--N)<C5 

uniformly in n. By Theorem 1 of [6], the limit lim^^oo kt{e)/t exists Pg^^-a.s. 
and is strictly positive; the distribution of the limiting vector limt_»oo(^t(e)/i) 

equals Q^"'^ the distribution of the random environment on Further- 
more, by (3.19), Xe^^/Xg?^ = x^r\ Hence, the left-hand side of (3.28) equals 

(3.29) 

= p(")(ii")(w('")) >e-^4l'^l). 
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We used Lemma 3.3 in the last step. Thus, the bound (3.28) and equa- 
tion (3.29) imply the estimate (3.26). 

Taking the limit as n — > oo in (3.26), the claim (3.27) follows from Lemma 3.4. 

□ 

Lemma 3.6 (Normalizability). The infinite series X^eeS'^e ^"^ ¥-almost 
surely finite. 

Proof. This follows from (3.27) by a Borel-Cantelli argument. □ 

Proof of Theorems 2.4 and 2.21. The sum J2e^E^<^ P-almost 
surely finite by Lemma 3.6. Hence, x{lo), as defined in (2.48), is P-almost 
surely well defined, and clearly, X^eeE ~ 

Let TT = [vq = 0,vi, . . . , Vk) be a path in G. For n> k, the random walker 

— (n) 

cannot visit the ends of the finite graph G up to time k. Hence, the 
probability to follow the path vr up to time k agrees for the reinforced random 
walker on G and on G^"^^ : 

(3.30) Po{{Xs)s=o,...,k = 7t) = P(S"^((X,),=o,...,fe = vr). 

— (n) 

Recall that the edge-reinforced random walk on G can be represented as 
a mixture of reversible Markov chains with mixing measure Q^"^. Hence, 
using Lemmas 3.3 and 3.4, 

p(")((x,),=o,...,fe = ^) = /Qo,xw((^«)^=o,...,fc = ^)Q^"H'i^^"^) 

= / Qo,iWM"))((^s)s=o,...,fc = vr)p(")(da;(")) 

(3.31) J go,xH {{Xs)s=o,...,k = 7r)F{duj) 

(3.32) = J Qo,i((^.)s=o,...,fc = vr)Q(dx); 

recall that Q is the law of x with respect to P. 

Now, any random walk distribution is uniquely determined by its values on 
the events A = {{Xs)s=o,...,k = '^}- Thus, (3.30) and (3.32) imply that edge- 
reinforced random walk on G has the same distribution as a random walk in 
a random environment with weights having the distribution Q. By (2.46), 
the environment is normalized so that Xp* = 1. 

Moreover, the weights Xe and Xe are proportional by (3.19); hence the 
Markov chain probabilities Qo,x and Qo,x coincide. Thus, it follows from 
(3.30) and (3.31) that edge-reinforced random walk on G has also the same 
distribution as a random walk in a random environment Q, given by weights 
x{uj), where uj has the distribution P. 
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By Theorem (7) of [3], the mixing measure Q is uniquely determined, 
because the reinforced random walk on G is recurrent as was shown in 
Lemma 5.2 of [7] and Proposition 5.1 of [10]. We conclude that (2.8) holds. 

□ 

Proof of Theorem 2.5. By the conversion (3.19), xi"V^?^ 
and Xe/xe* = Xe- Using Lemma 3.3 and Theorem 2.21, the claims follow 
immediately from Lemma 3.5. □ 

Let us summarize the key statements in Lemma 3.3 and Theorem 2.21. 

Connection between the random environment and the Gibbs measures: 
Q equals the law of x{uj) if lj has law P. 
Q(") equals the law of x(")(a;(")) if a;(") has law p("). 

3.2. Properties of the random environment. 

Proof of Theorem 2.7. First, we show that for any finite path p = 
{vk, . . . ,vi) with I >k, we have 

P{{Xs)s=k,...,l = P\{Xs)s=0,...,k = 71") 

(3.33) 

, Qo,x{{Xs).s=0,...,k = 

Po{{Xs)s=o,...,k = tt) 



Qv^:,x{i^s)s=k,...,l = P) T^nv\ Q{dx). 



Let Trp denote the concatenation of vr and p. By the Markov property 
for Q.^x and the representation of the edge-reinforced random walk as a 
mixture of Markov chains [identity (2.8) in Theorem 2.4], the right-hand 
side of (3.33) equals 



Ja Qo,x{iXs)s=0,...,l = T^P) Qidx) 

(3.34) 



Po{{Xs)s=0,...,k = Tt) 

Po{iXs)s=o,...,i = Trp) 



Po{{Xs)s=0,...,k = 71") 
= PoiiXs)s=k,...,l = p\{Xs)s=0,...,k = Tt). 

Thus, (3.33) holds. 

Since the distribution of {Xk+t)teNo is uniquely determined by its values 
on events of the form {{Xs)s=k...i = p}, (3.33) generalizes to 



P{{Xk+t)teNo £ A\{Xs)s=o,...,k = tt) 

(3.35) 



f r^ r/v \ ^ ^.n Qo,x((^s)s=0,...,fc — ^r) , , 

^/ Q„,,x((^fc+i)tGNo e A)— — — '-^ ^Q{dx). 



Po{iXs)s=o,...,k = tt) 
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This proves the claim (2.13) for the measure Qtt with the Radon-Nikodym 

derivative (2.14). In particular, taking A = V ° in (2.13), we see that Qt^ is 
a probability measure. The uniqueness of Q^^ follows immediately from the 
uniqueness of Q stated in Theorem 2.4. □ 



Proof of Theorem 2.8. By Lemma 3.4, the finite-dimensional marginals 
of Q(") converge weakly to the corresponding marginals of Q. By Theorem 

10.1 in Chapter 3 of [11], there exists a coupling {{xl )^^-^,n G N, (xe)^^-^) 

with a coupling measure Q, such that 

(3.36) lim x^"^ = Xg pointwise for all e G i?, 

n — ^oo 

(xe)ec"E has the law Q, and (a^i"^) ^-^ has the law Q("). More precisely, we 



set Xe^' = whenever e is not an edge in G^'^\ and we let {xe^') —(„) have 

the law Q("). 
We claim that 



(3.37) 



lim y = y Xe, Q-a.s. 



This can be seen as follows. Recall that Xg = Xe/x^,*. Hence, from (2.10) of 
Theorem 2.5, we know that for every edge e. 



(3.38) 

Let e ^ 

e/2. We estimate 



-C4|e|\ ^ 



cse 



Let e > 0. Take m so large that Y] — (m) c^e' 



-C6|e 

--N<e/2andE,,^^^(^,e- 



-C4|e| 



< 



(3.39) 



(n) 

e 

eGiJ eeU 



< E 



+ E 



1 37g ''I ~\~ I 



The convergence (3.36) implies that the first sum on the right-hand side 
of (3.39) converges to Q-a.s. as n — > oo. Therefore, we conclude 



lim sup 



E^i"^-E 



e€E 



e€E 



(3.40) <Q(limsup ^ [| 



> £ 



< 



E m 



-C4\e\\ 



+ Q{Xe>e 



-C4\e\ 



< £. 



e^E\E^^^ 
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This implies the claim (3.37). 

As a consequence of our normalization = 1, we know X^ees^^ > 1- 
Hence, (3.36) and (3.37) imply that we have for all e G 



(3.41) lim 



.(n) 
Xe 



. n 

hm j-^ 



p-a.s. 



We know that the Q-distribution of (xe"VZ] ^i"^) equals Q^'") 

by Lemma 3.3, and the Q-distribution of (s^e/ Se'es ^e')ee"B equals Q by 
Theorem 2.21. Hence, (3.41) implies that the finite-dimensional marginals 
of Q(") converge weakly to the corresponding marginals of Q. □ 

Proof of Theorem 2.9. Since the sum of finitely many random vari- 
ables with exponential tails has again exponential tails, Theorem 2.2 of [10] 
(see also Theorem 2.3 of [7]) implies the following tail estimate in finite vol- 
ume: There exist positive constants 07(0), 03(0), depending only on a, such 
that one has for all n G N, {0, 1, . . . , n} with \i — j\ <1 and M > 0, 



(3.42) 



1 Xe 
Xp' 



> M 



-csM 



whenever e,e' are edges on level i, j, respectively. 

Now, let e, e' be edges on arbitrary levels i 7^ j, respectively. Then, we can 
write ln(xe/2;e') as a sum of \i — j\ terms of the form \n{xf/xf') with / and 
/' edges on neighboring levels. Hence, 



(3.43) 



In- 



Xp' 



> M 



< C'j\i — j\e 



-cgM/ji-il 



follows. Note that the constants cy and cg are independent of n. By Theorem 
2.8, we can take the limit as n ^ 00 in the inequality (3.43); note that the 
distributions of all ln(xe/xe'), e 7^ e', with respect to the limit law Q are 
continuous. This yields the claim (2.16) and completes the proof of the 
theorem. □ 



Proof of Corollary 2.6. Fix f e E. For ee E, we define the event 
(3.44) ^e:=K>e~'4'^'/^x/} 

with C4 as in Theorem 2.5. By (2.46) the weights Xp are normalized so 
that Xp* = 1. Furthermore, Xp and Xp are proportional with Xp = Xp/xp* . An 
application of the estimate (2.10) from Theorem 2.5 and the bound (2.16) 
from Theorem 2.9 yield 



(3.45) 



QiAp) < 



(Xp > e 



-C4 |e 



XeS)+< 



C4\e\/2 
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with constants CQ{f) > and cio(/) > 0. Thus, Z]e6'E'Q(^e) < oo, and the 
Borel-Cantelh lemma hnphes that Q-a.s., the event Ae holds for at most 
finitely many e£ E, that is, Q-a.s., there exists uq such that for all n > no, 
the claim (2.11) holds. □ 

3.3. Asymptotic properties of the reinforced random walk. 

Proof of Theorem 2.1. Let v £ V he a vertex and x £ A. Since 
J2e<=:E^^ = 1, we know X^^gy^^i' = 2; recall the notation (2.7). Furthermore, 
with respect to the invariant distribution vr = (x„/2)^gy , the random walk 
Qn,x in the fixed environment x is reversible; see, for example. Example 4.5 
on pages 298-299 of [5]. We conclude that 

(3.46) xoQo,xiXt=v) = XvQv,x{Xt = 0) 
and therefore 

(3.47) QoAXt = v) = ^Q.AXt = 0) < ^ < ^. 

Xq Xo Xel 

Taking now a random environment x, we consider the event 

(3.48) = j^>^^e"^4(|fhi) 

where k denotes the coordination number of G, i.e. the maximal number of 
immediate neighbors that a vertex in G can have. We estimate, using the 
bound (3.27) from Lemma 3.5 and the fact x^/xg* = X^egE- iise 

P(A„)< F(ie>e-'=^(l^l-i)) 

(3.49) < P(ie >e-'^4l'=l) 

note that |e| > |w| — 1 if u G e. Using the representation (2.8) of Pq as a 
mixture of the Qcx , we get the bound 

Po{Xt = ^)=J^ QoA^){Xt = v) ndoj) 

= [ QoAXt = v)dF+ [ Qo,x iXt = v) dF 

(3.50) 

< / ^dF + F{A,) 

J A- 

<^e-c4(K-|-i) + ^ggg-c6{H-i)_ 



ASYMPTOTIC BEHAVIOR OF ERRW 



25 



The claim (2.1) of Theorem 2.1 follows from this bound by summation over 
all vertices v with |f | > n. □ 

Proof of Corollary 2.2. By Theorem 2.1, we know that for all 
C3 > and t > 2, the following holds: 



in particular the probabilities in (3.52) are summable over t. Hence, by the 
Borel-Cantelli lemma, we know that Po-a-S- the claim (2.2) holds. □ 

Proof of Theorem 2.12. Let x G A. RecaU that {xv/2)^^y is a re- 
versible probability distribution for the Markov chain Q.^x- All closed paths 
in G = No X G have an even length because G is acyclic. Hence, all states 
V have period 2. Furthermore, the Markov chain Q.^ is irreducible. 
Consequently, by the convergence theorem (5.7) on page 315 of [5], (2.23) 
and (2.24) follow. 

To prove (2.25), let A C be measurable. Note that the convergence 
in (2.23) holds also in the /^-norm on by the discrete version of Scheffe's 
theorem. Hence, we can exchange infinite sum and limit in the following 
calculation: 




-C2C3 hit 



We choose C3 large enough that 1 — C2C3 < — 2. Then 



(3.52) 




lim Qo,x((-'^2s+t)iGNo G^) 



= lim V Qo,x{i^'2s+t)t<mo G A\X2s = v)Qo,xiX2s = v) 



(3.53) 



= lim V Qy x{iXt)teNo ^ ^)Qo,a;(^2s = v) 



= Y] Qv,x{iXt)teNo G A) lim Qo,x(^2s = v) 




By the same argument, the last claim (2.26) follows. □ 



Proof of Theorems 2.3 and 2.10. We combine the representation 
of the reinforced random walk as a mixture of Markov chains (Theorem 2.4) 



26 



F. MERKL AND S. W. W. ROLLES 



and the convergence to equilibrium, conditioned on the environment (The- 
orem 2.12). By the dominated convergence theorem, this yields 

lim Po{X2t = v)= [ lim Qo,AX2t = v) Q{dx) 

t— >oo J A t—>oo 

(3.54) 

Xcven(f ) Qidx) =: Heveniv) 

for all V gV. Since Xcvcn is a probability function, by the monotone conver- 
gence theorem, ^even is a probability function as well. 

In order to prove the upper bound for Hcvcn{v), we use (3.54) and Theo- 
rem 2.1: 



(3.55) /icvcn('y) = lim Po{X2t =v)< limsupPo(|-'^2t | >\v\)< cie 



-£211)1 



t— too 



The convergence of the distribution of X2t+i and the claims for /iodd are 
proved analogously. □ 

Proof of Theorem 2.11. The claim follows from Theorems 2.4 and 
2.12 and the dominated convergence theorem. □ 
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